Prosody Variation: Application to Automatic Prosody Evaluation of Mandarin Speech
نویسندگان
چکیده
Prosody evaluation is an essential part of computer-aided language learning system. In the paper, prosodic variability among inter-speakers is investigated based on a database containing eight repetitions of 200 sentences. For Mandarin of reading style, its variability can be analyzed from rhythm, intonation and tone. Experimental results show that the mean correlation of tone between inter-speakers is 0.70, intonation and rhythm are 0.81. Based on these analyses, the prosodic similarity between the tested and standard utterances is calculated to automatically evaluate prosody quality. The standard utterances were recorded by multiple speakers, so they can cover different prosody patterns for the same utterance. The prosodic similarities are calculated from three aspects: tone, intonation and rhythm. Based on these similarities, the prosody quality can be graded. The method evaluated on the collected database has achieved good performance, and the correlation of human-machine scores is close to that of human-human scores.
منابع مشابه
Automatic Prosody Quality Evaluation of Mandarin Speech
Prosody evaluation is an essential part of computer-aided language learning system. In the paper, we investigate an automatic prosody evaluation method for Mandarin speech. The method is based on prosody comparison between the tested and standard utterance. The prosodic similarities are calculated from three aspects: tone, intonation and rhythm. Based on these similarities, a ranking algorithm ...
متن کاملAn automatic prosody labeling method for Mandarin speech
A new model-based automatic prosody labeling method for Mandarin speech is proposed. It first introduces four models to describe the relationships of the prosody tags to be labeled, the prosodic features of the speech signals, and the linguistic features of the associated texts. It then employs a sequential optimization procedure to estimate parameters of these four models and find all prosody ...
متن کاملUsing prosody to improve Mandarin automatic speech recognition
In this paper, these problems of how to model and train Mandarin prosody dependent acoustic model and how to decode input speech based on prosody dependent speech recognition system will be discussed. We use automatic prosody labeling methods to annotate syllable prosodic break type and stress type on continuous speech corpus, and utilize our proposed methods to train prosody dependent tonal sy...
متن کاملEvaluating prosody of Mandarin speech for language learning
This paper proposes an approach to automatically evaluate the prosody of Chinese Mandarin speech for language learning. In this approach, we grade the appropriateness of prosody of speech units according to a model speech corpus from a teacher’s voice. To this end, we build two models, which are the prosody model and the scoring model. The prosody model that is built from the teacher’s speech p...
متن کاملSpeech Rate and Prosody Units: Evidence of Interaction from Mandarin Chinese
This paper discusses evidence of interaction found between speech rate and prosody units in Mandarin Chinese speech. Mandarin speech data of 2 different speech rates that had been previously labeled for perceived boundaries and prosody units were further analyzed for duration patterns at each prosodic level. Each prosody level demonstrated patterns of duration adjustment for both speech rates t...
متن کامل